Probing spin glasses with heuristic optimization algorithms 
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A sketch of the chapter appearing under the same heading in the book "New Optimization Al- 
gorithms in Physics" 0] is given. After a general introduction to spin glasses, important aspects of 
heuristic algorithms for tackling these systems are covered. Some open problems that one can hope 
to resolve in the next few years are then considered. 

PACS numbers: 02.60.Pn Numerical optimization; 75.10.Nr Spin-glass and other random models 



I. INTRODUCTION 



Understanding the physical properties of ^in-glass 
materials is a long-standing challenge |3j S 3 • Their 
exotic properties are believed to be controlled by the low 
energy configurations, a configuration being the specifi- 
cation of the orientation of each of the system's magnetic 
dipoles. The physical origin of these dipoles is the "spin" 
of the electrons as in ordinary magnetism, but it is the 
"irregular" nature of the couplings between these spins 
that gives these materials their striking properties. To 
understand most of the phenomenology of equilibrium 
spin glasses, it should be enough to find the system's 
ground state and low energy excitations: that is why 
much effort has focused recently on applying optimiza- 
tion algorithms to spin glasses. Furthermore, spin glasses 
are the archetypes of complex systems; what is learned 
here is expected to have a strong impact on our under- 
standing of many other systems with competing effects. 

In one of the first attempts to theoretically tackle the 
competing interactions in these systems, Edwards and 
Anderson ||5| (EA) considered spins on a regular square 
or cubic lattice, and introduced spin-spin couplings Jij 
as quenched independent random variables. The corre- 
sponding Hamiltonian is 



Hea = - 



7 , JijSiSj 



(1) 



They argued that the orientations of the spins 5^ = ±1 
should "order" at low temperatures, but at random, as 
would follow for instance from minimizing He a- Much of 
the theoretical research on spin glasses since 6] has con- 
firmed this idea, but it has been difficult to make firm 
claims accepted by all, to a large extent because numer- 
ical computations are restricted to small sizes and the- 
oretical approximations are of limited reliability. Work 
in this field has been quite fruitful in the last 10 years; 
further progress may be expected but it will require ma- 
jor advances in the algorithmics. We thus consider now 
some of the corresponding issues. 



II. USING HEURISTIC ALGORITHMS 

It is convenient to divide algorithms for finding ground 
states into two classes: "exact" or complete, and "heuris- 
tic" or incomplete. In the first class, the algorithms will 
terminate and for sure provide the minimum energy so- 
lution; unfortunately they tend to be slow. Our focus 
here is on heuristic algorithms: such algorithms provide 
good but not necessarily optimal solutions. They should 
be used to find ground states only if one can measure 
their reliability, i.e., if can one convince oneself that the 
failures to find the true optima arise so rarely that they 
make no difference for the study. Given this drawback, 
heuristics have the advantage of being easy to program 
and of being very fast; this often allows researchers to 
quickly tackle relatively large systems with little pain. 

If the Hamiltonian's ground state is unknown in gen- 
eral, how do we measure the reliability of a heuristic algo- 
rithm? We can perform a self-consistent test by running 
independent multiple starts of the algorithm. As an illus- 
tration, assume one has performed 10 independent runs 
of the algorithm. If all 10 outputs are identical, there is 
good reason to expect that the true ground state has been 
found. If on the contrary the 10 outputs do not all agree, 
the heuristic is not so reliable. Generally, it seems un- 
avoidable for heuristics to become unreliable as the num- 
ber N of spins becomes large; the challenge is to postpone 
this bad behavior as much as possible. To illustrate this 
point, we ran a heuristic called Kernighan-Lin 8] on 
Ising spin-glass samples of increasing N. Fig.^shows the 
distributions of the energies per spin found when using 
random starts: for each size {N = 20, 50, 100 and 170), 
the histogram is for a single sample, i.e., a single choice 
of the quenched disorder (the Jij). 

When N = 20, the distribution is dominated by the 
probability of finding the lowest energy Eq (which pre- 
sumably is that of the ground state), P{Eq) w 0.98; this 
problem size is thus extremely simple to "solve" . Increas- 
ing the instance size to = 50, the distribution is still 
peaked at Eq but much less so: P{Eo) « 0.35. Going on 
to = 100, the distribution becomes bimodal. Finally, 
for N — 170, the peak at Eq has disappeared and the 
distribution is bell shaped. All in all, as N increases, 
the quality of the algorithm, as measured for instance 
by P{Eo), deteriorates very clearly. Any heuristic algo- 
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FIG. 1: Distribution of energies per spin for the KL algorithm 
applied to four samples with = 20, 50, 100, and 170 spins. 

rithm will follow this pattern of "simple" to "difficult" as 
N grows. Such a behavior is generic; the main difference 
from one heuristic algorithm to another is the typical 
value of N where there this cross-over from simple to 
difficult arises. 

In practice, a given heuristic will give estimates of Eq 
that are self-averaging, leading to a fixed percentage error 
in the ground-state energy density in the thermodynamic 
limit. Furthermore, the probability of finding the exact 
ground state tends to zero exponentially fast in the num- 
ber of spins N. These properties 7] allow one to com- 
pare different heuristics and determine the usefulness of 
resorting to multiple independent starts. Today's most 
used algorithms find ground states with a high reliability 
for 1000 spins but fail badly beyond 3000 spins. 



III. SOME PHYSICAL CHALLENGES 

Let's focus on the EA model in dimension 3 as the 
stakes there are the highest. The definition of this model 
is very compact (cf. Eq. ^ ; it thus seems unbelievable 
that even the qualitative features of this system are still 
subject to debate! Of interest to us here are the unsettled 
issues directly related to optimization, namely the nature 
of the ground state and its low- energy excitations. In the 
last few years, several teams 0, llfl Ull Ej, US i ^^ch with 
their own codes, have investigated these issues that we 
now highlight. 

Phase diagram — In most studies, the Jij in Eq. are 
taken from a distribution symmetric about 0. If instead 
Jij < for only a small fraction of the couplings, the 
system is ferromagnetic and resembles the ordinary Ising 
model. As the fraction of anti-ferromagnetic couplings 
is increased beyond a critical value, the ferro-magnetism 
disappears. Does the spontaneous magnetization vanish 
just as the spin-glass ordering appears? Can there be 
a "mixed" phase where the two types of orderings co- 
exist? Such a phenomenon is expected within the mean- 



field picture [p. On the contrary, the droplet/scaling 
picture p^ll5|| savs no such coexistence can arise. Only 
recently has this question been considered numerically 
but the issue is still far from settled. 

An analogous situation appears when an external per- 
turbation in the form of a magnetic field B is applied. 
In the droplet/scaling picture, the spin-glass ordering is 
destroyed as soon as B ^ 0, leading to a paramagnetic 
phase. On the contrary, in the mean-field picture, spin- 
glass ordering co- exists with the net magnetization in- 
duced by B as long as B is not too large. Numerical 
studies suggest that no co-existence occurs in 3 dimen- 
sions, but further work is necessary. 

Energy landscapes — Now consider the organization of 
the low-energy configurations. Can one give a statistical 
description whereby some of their properties "scale" ? By 
that we mean that for instance a characteristic energy 
has a power-law scaling with N as N ^ oo. {N is the 
number of spins in the system.) The mean- field picture 
predicts the following properties. 

(i) Clustering: Given a low energy configuration, it is 
possible to further flip 1, 2, and more spins if they are 
carefully chosen without changing substantially the value 
of the excitation energy. The set of low energy config- 
urations form families or "clusters" ; two configurations 
belong to the same cluster if their Hamming distance is 
very small compared to N. 

(ii) Replica symmetry breaking: Among the clusters 
formed by the low energy configurations, consider the 
ones in which a finite fraction x of the spins are flipped 
compared to the ground state. (By finite we mean that x 
is fixed, < a; < 1, and then one focuses on the large N 
limit with that given x.) In mean field, the corresponding 
lowest excitation energy is 0(1). Furthermore, the sys- 
tem has continuous replica symmetry breaking, meaning 
that X can take on values that span at least some sub- 
interval of [0, 1]. 

(iii) Ultrametricity: One defines the distance between 
two configurations as their Hamming distance divided 
by N. One can also define the distance d{a,P) between 
two clusters of configurations from the mean distance of 
their respective members. In mean field, it turns out that 
the low energy clusters are organized hierarchically: each 
cluster is divided into sub-clusters which are themselves 
sub-divided. . . Furthermore, if we think of clusters as 
being points in an abstract space, that space is ultramet- 
ric, i.e., all triangles are isosceles. 

It is a major challenge to understand whether these 
remarkable properties also arise in the 3-dimensional 
EA model. Of course they may not; for instance the 
droplet/scaling picture may hold instead. In that pic- 
ture, scaling laws play a central role but so do "position- 
space" properties. At the heart of these is the notion of 
droplet excitations above the ground state; a droplet is 
defined on a given scale £ and around a given spin 5'o 
as follows. One considers all connected clusters of spins 
that are enclosed in the cube of side 2£ centered on Sq 
but which are not contained in that of side t, among all 



3 



these potential excitations, the droplet is the one of low- 
est energy. The authors of the droplet/scaling picture 
postulate the following properties, (i) Droplet energies 
grow as a positive power of their volume, (ii) There is no 
replica symmetry breaking, (iii) The organization of the 
low energy clusters is not hierarchical; nevertheless, the 
energy landscape is self-similar, i.e., it is a fractal. 

Just as for the phase diagram, studies of energy land- 
scapes have not led to any consensus in spite of much 
work. The root of this problem may very well be that 
new theoretical frameworks 0, 0| are necessary. 



stood. Without such an understanding, it is very difficult 
to extrapolate to the thermodynamic limit, i.e., A'^ — > oo. 
This means that algorithmic improvements have to be 
important, allowing us to go to significantly further in N. 
Currently, we can perform studies involving about 2000 
spins. It would probably be necessary to at least dou- 
ble that to have good enough control over the finite-size 
corrections and to settle long-standing disputes "beyond 
reasonable doubt" . 



IV. OUTLOOK 



If spin glasses are so controversial, it is largely because 
finite-size effects in these systems are not well under- 
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